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We study dependence of the atmospheric i/^ and fluxes on the deviations of the 2-3 mixing from 
maximal, |45° — 023 1, on the S23-octant and on the neutrino mass sphtting Am^2- Analytic expres- 
sions for the 023— deviation effect and the octant asymmetry are derived. We present conservative 
estimations of sensitivities of the iron (magnetized) calorimeter detectors (ICAL) to these param- 
eters. ICAL can establish the S23-deviation at higher than 3cr confidence level if |45° — S23I > 6° 
with the exposure of 1 Mton-yr. Sensitivity to the octant is low for zero or very small 1-3 mixing, 
but it can be substantially enhanced for ^13 > 3°. ICAL can measure the difference of Am^2 in 
and v channels (the CPT test) with accuracy 0.8 X 10"'' eV^ (3a) with 1 Mton •yr exposure, and 
the present MINOS result can be excluded at > 5a confidence level. We discuss possible ways to 
further improve sensitivity of the magnetized spectrometers. 

PACS numbers: 14.60.Pq,14.60Lm 



I. INTRODUCTION 

Determination of the 2-3 mass splitting and lep- 
tonic mixing, and in particular, the deviation of 623 
from the maximal mixing angle, 

523 =45° -023, (1) 

is of fundamental importance ^ . Here we use the stan- 
dard parameterization of the PMNS mixing matrix: 

UpMNS = U2?,{Q2z)^ sUi3{6i3)Ui2{9i2), (2) 

where Uij is the matrix of rotation in the ij— plane, 
and Ts = diag(0, 0, e"'). Being maximal or close to 
maximal, the 2-3 mixing testifies for existence of cer- 
tain underlying symmetry []_]. Comparison of the val- 
ues of (523 and 013 as well as the mixing angles in the 
quarks and lepton sectors can shed some light on the 
origins of fermion mass and mixing in general. 

The existing results on 023 ^^nd A77123 are sum- 
marized in the Table 1. Note that the global fits of 
oscillation data [2] (see also [3]) show some deviation 
of the 2-3 mixing from maximal: 823 = 2 — 3° (Icr). 
Although the data agree well with maximal mixing, 
large deviation, 823 = ±9°, is still possible. 

Concerning the 2-3 mass splitting, the global 
fit values are in agreement with the results of Su- 
perKamiokande (SK) [4] as well as the MINOS mea- 
surement in the v channel [5]. 



^ (523 is related to another deviation parameter, D23 = 1/2 — 
sin'^ 023 used in literature as Z?23 = sin 2(523- 



Recently MINOS has reported the values of 
Am|]^ and 023 in the v channel [5] which differ from 
those in the v channel (see tables I and II). If con- 
firmed, this result will testify for an effective (due to 
existence of some new interactions [G]) or fundamental 
CPT violation. The analysis of the atmospheric neu- 
trino data does not confirm MINOS result although 
the sensitivity of SK to CPT violation is not high since 
SK sum up effects of neutrinos and antineutrinos [G] . 
Iron calorimeters (ICAL) [7] can perform very sensi- 
tive search for the CPT violation and check MINOS 
result. 

New accelerator experiments T2K [8] and 
NOi^A [9] will improve precision of measurements of 
Am|2 by factor 2, but their accuracy of measurements 
of 023 will be only slightly better than that of the 
present global fit (see table I). 

There are two aspects of the 023-measurements: 

• determination of the absolute value of the devi- 
ation |(S23|, and 

• identification of the 023-octant, i.e. the sign of 
(^23, or in other words, resolution of the octant 
degeneracy. 

The problem of determination of 823 and the oc- 
tant with atmospheric neutrinos has been addressed 
in a number of publications before [10-lG]. It was re- 
alized [11-13] that at low energies oscillation effects on 
the electron neutrino flux are proportional to this de- 
viation, and therefore searches for an excess (or sup- 
pression) of events in the sub-GeV range would testify 
for 823. For water Cherenkov detectors both aspects 
of the 2-3 mixing determinations have been explored 
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in [12, 13]. The study was mainly concentrated on 
effects in the electron neutrino flux. 

Magnetized calorimeters are mainly aimed at a 
detection of the muon neutrinos, but they can dis- 
tinguish neutrinos and antineutrinos, and this com- 
poses their main advantage. These detectors provide 
better energy and angular resolution of the charged 
leptons, and consequently, neutrinos. A possibility to 
disentangle neutrinos and antineutrinos reinforces the 
following features: i) The energy and angular resolu- 
tions (reconstruction) are different for neutrinos and 
antineutrinos. ii) Sensitivities of the neutrino and an- 
tineutrino channels to the oscillation parameters are 
substantially different. 

Sensitivity of a magnetized calorimeter to the 2-3 
mixing and mass splitting has been explored in [14] 
and [la]. It has been shown that at nonzero value of 
the 1-3 mixing the octant discrimination is more feasi- 
ble with the magnetized detector than with the water 
Cherenkov detector since the former can directly mea- 
sure the matter effect [14]. In these studies, however, 
various simplifications have been made which do not 
allow for realistic estimations of potential of the ex- 
periments. In the analysis [17] a possibility of the oc- 
tant discrimination has been evaluated for two bench- 
mark values of 6'23 and relatively high 613 = 7.5°. 

Here we present a comprehensive study of sensi- 
tivities of the ICAL to the parameters of 2-3 sector. 
We assume that by the time of operation of this de- 
tector certain information about ^13 will be obtained. 

The paper is organized as follows. In sec. II we 
study dependence of the u^^ and fluxes on param- 
eters of the 2-3 sector: \S23\, octant and Am^s- In 
sec. Ill we describe details of our statistical analy- 
sis. Wc evaluate physics potential of the magnetized 
calorimeter to measure these parameters in sec. IV. 
In sec. V we consider further improvements of sensi- 
tivities of the magnetized calorimeters. Conclusions 
are given in sec. VI. 



Here the flavor ratio 



r{E,ez) = 



(4) 



is function of the neutrino energy E and zenith angle 
Oz- 

For the standard parameterization of the mixing 
matrix dependence of the oscillation probabilities on 
the 2-3 mixing 623 and CP-phase 6 is explicit for an 
arbitrary density profile. This follows from the order 
of rotation in eq. (2) and the fact that the matrix 
of matter potentials has the form V — diag{Ve, 0,0} 
in the fiavor basis, i.e. it is invariant under the 2- 
3 rotations. Indeed, the neutrino evolution can be 
considered in the propagation basis, i> = (z/g, i>2, t'a), 
defined via the following relation with the flavor basis: 
vf = U23rsi>. Consequently, i> = Ui3Ui2Vmass, where 
lymass = (I'l, 1^2,1^3) is the basis of mass eigenstates. In 
the propagation basis the Hamiltonian, and therefore 
the amplitudes of transitions depend on ^13,^12, 14, 
and mass squared differences: 



A, 



7l3i C'12 



a,/3 = e,2,3, (5) 



and they do not depend on 623 and S. In the fla- 
vor basis, dependence of the amplitudes Af on these 
parameters appears via projections of the matrix of 
amplitudes (5) from the propagation basis to the fla- 
vor basis: 



Af - U23TsAr^sU^^, 



(6) 



where A-f is the matrix of amplitudes in the flavor 
basis. 

In terms of the amplitudes Aaj3 using cq. (6) one 
can rewrite the expression for the muon neutrino flux, 
eq. (3), in the following form [18]: 



1 — sin^ 29o3 sin^ 



■ sin^ 26*23 cos [l - RciA^^A^^ 



II. DEPENDENCE OF THE ATMOSPHERIC 
NEUTRINO FLUXES ON 2-3 MIXING 



- [s^23-'f)PA-(4,-'f]Ps 



sin 2023^^5, 



(7) 



The original atmospheric neutrino flux contains 
both the muon, i^^, and electron, F^, neutrino com- 
ponents, so that the muon neutrino flux at a detector 
equals 



F„ 



= F° 



r 



(3) 



where 



Pa 



and Ps 



(8) 



are the probabilities of transitions j/g — > V2 and 
Ve — ^ V3 correspondingly, and Pf, is the function which 
depends on the CP-violation phase (5. In eq. (7) is 
the oscillation phase due to the 2-3 mass splitting: 
= Am|2a;/2i?, C23 = cos^ 6*23, etc.. Notice that Ps, 
Pa; Ps and do not depend on 623. 
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In eq. (7) the first two terms are due to vacuum 
oscillations driven by the 2-3 mixing and mass split- 
ting; the second line describes interference of the 2-3 
and 1-2 modes of oscillations. The product of ampli- 
tudes in this term can be approximated as 



1^22^33! 



(9) 



The terms in the third line describe effects of oscilla- 
tions due to the 1-2 and 1-3 mixing. The last term 
in (7) describes the CP-violation. The leading (sec- 
ond) term as well as the interference and CP-violating 
terms are symmetric with respect to change of sign of 
the deviation: 623 — >■ —623. The octant symmetry 
(degeneracy) is broken by the terms in the third line 
of eq. (7); these terms vanish for the maximal 2-3 
mixing and r — 2. 

For antineutrinos one obtains the same formula 
as in eq. (7) with substitution Ps Ps, Pa Pa 
and r — > f. 

The octant effect can be characterized by the oc- 
tant asymmetry defined as 

A OCt p -1 

— ^ ^ [F^(45° + S23) F,{45° S23)] . 

(10) 

For such symmetric deviations from the maximal 2-3 
mixing one has 

A(sin2 2023) = 0, 

A(COS2 023) = A(C0S4 023) - -sin 2523- (11) 

Then according to eq. (7) the octant asymmetry 
equals 

" =sin2(523 (1--) (Pa-Ps)- (12) 



po 



Notice that Ps and Pa enter the asymmetry with op- 
posite signs, and therefore partly cancel each other. 

To get an idea about dependences of the prob- 
abilities on the neutrino parameters one can use ex- 
pressions for the amplitudes in medium with constant 
density: 



cr3sin20r2sin</.^i 



= sin 20'" 



'^32'^ 



cos^ 6lJ'^sin0^1 13) 



The probability Ps oc sin^ 29^ decreases with energy, 
whereas Pa oc sin^ 26*5^ increases being resonantly en- 
hanced in the neutrino channel (for the normal mass 
hierarchy) at high energies. Here sensitivity of ICAL 
to the sign of muon charge will play important role. 
The two probabilities become comparable at 1 GeV 
for sin^ 6*13 - 0.01. 



In the limit of zero 1-3 mixing Pa = 0, Ps ^ Ps, 
and one finds from eq. (7) 

sin^ 26I23 sin2 ^ - i sin^ 26*23 cos cj) x 



(1 - yr-p;) - U 



23 - f ) Ps, (14) 



where Ps = Ps {di3 = 0), which is the 2i/ probability 
of oscillations driven by Am^i and 9i2- For the octant 
asymmetry wc obtain 



sin2fe [1--] Ps- (15) 



At low energies: r « 2, and therefore the asymmetry 
equals ~ 1/2 sin 2(523 Pg. 

In fig. 1 we show the oscillograms for the oc- 
tant asymmetry, that is, the lines of equal asymmetry 
A°'^*i^^/F° in the E — cosOz plane in neutrino and 
antineutrino channels. According to eq. (15) these 
oscillograms coincide with the oscillograms for Ps up 
to coefficient which weakly depends on E and 6z at 
E < 1 GeV. We use ^23 = 5°, 613 = 0, and other 
parameters are set at their best-fit values. The asym- 
metry increases with decrease of the neutrino energy. 
Maximal asymmetry is achieved in the 1-2 resonance 
{E - 0.1 GcV): A°'=*F^/F0 « 0.087. For realistic 
threshold Eth = 0.3 GeV and S23 ~ 5° the averaged 
asymmetry is about (2 - 3)% and for Eth = 0.8 GeV 
it is below 1%. 

Notice that the octant asymmetry of i^e— flux is 
about 4 times larger than the i^,,— flux asymmetry: 



- sm2523 r Ps- 



(16) 



Here, however, the original i/g— flux is 2 times smaller. 
Furthermore, detection of muons provide better en- 
ergy and direction resolutions. 

Since Ps and Ps are of the same order, separation 
of the neutrino and antineutrino signals has no sense 
here. 

Let us consider variations of the f^-flux due to 
deviation of the 2-3 mixing from maximal. According 
to (7) the relative change of the flux, which we will 
caU the ^23— deviation effect, equals 

A'^^^f^ ^ F^(45°)-f^(45°-^23) 
po ~ po ~ 

- A(sin2 2023) sin^ ^ = sin^ 262^,17) 

where in the last equality wc have averaged the oscil- 
lations due to large mass splitting. 
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Ratio of the octant asymmetry and the 2-3 devi- 
ation effect equals 



23 



1 - 



{{Pa)-{Ps)), (18) 



where (Ps) and {Pa) ai'c the probabihties averaged 
over the experimental E — cos 9z ranges. Although 
^devpo proportional to square of the deviation pa- 
rameter, for not very small S23 (> 5°) and ^13 = 0, 
the integral effect of the deviation from maximal mix- 
ing is stronger than the effect of octant. The reason is 
that the deviation effect does not change with energy, 
whereas the octant asymmetry being proportional to 
Ps quickly decreases with E {(Ps) ^ (Pa))- For zero 
1-3 mixing and 823 = 5° we have A'^^i^^/i^o = 0.015, 
and A°'=^Ff,/F° = 0.087 (Ps). 

For non-zero 1-3 mixing at high energies the ratio 
of the flux differences is 



rj sm2^23 



and since Pa does not decrease with energy the ratio 
is not small in contrast to the previous case. 

In our studies of sensitivities to the parameters of 
2-3 sector we obtain the oscillation probabilities solv- 
ing numerically full three flavor evolution equation 
and using the Preliminary Reference Earth Model 
(PREM) [19] for the density profile of the Earth. We 
will use the consideration presented in this section for 
interpretation of the numerical results. 



is the length of neutrino trajectory. Choice of this bin- 
ning is motivated by pattern of the oscillation prob- 
ability P(i^^ vj) in the L - F plane [22]. The 
distance between two consecutive oscillation peaks in 
this plane increases (decreases) as one goes to lower 
L [E) values for a given E (L). The binning of L has 
been optimized to get better sensitivity to the oscilla- 
tion parameters. To maintain x^/d.o./. ss 1 in Monte 
Carlo simulation study, number of events should be 
> 4 per cell [17]. If the number is smaller than 4 
(which happens in the high energy bins), we combine 
results from the nearest cells. 

For each set of oscillation parameters we inte- 
grate the atmospheric neutrino flux at the detector 
over the energy and zenith angle folding it with the 
cross-section, the exposure time, the target mass, 
the efficiency of detection and the two dimensional 
energy-angle correlated resolution functions to obtain 
data for the analysis. We use the charge current 
cross section of NUANCE-v3 [20] and the neutrino 
flux of the 3-dimensional scheme [23]. 

The systematic uncertainties of the atmospheric 
neutrino flux are crucial for determination of the os- 
cillation parameters. We have divided them into two 
categories: (i) the overall flux normalization uncer- 
tainties which are independent of the neutrino energy 
and zenith angle, and (ii) the spectral tilt uncertain- 
ties which depend on E and 9z . The flux with uncer- 
tainties included can be written as 



^E,ez) = ME) 



1 . 1 E 
1 + Se logio -TT 
Eq 



X [l + dz{\cosez\-0.5)] X + 



(20) 



For E < 1 GeV we take the energy-dependent uncer- 
tainty: 6e = 15% and Eq = I GeV, and for E > 10 
GeV correspondingly, Se = 5% and Eq = 10 GeV. 
The uncertainty is (5b ^ 7% in the range E ~ 1 — 10 
GeV. The overall flux uncertainty as function of the 
zenith angle is parameterized by Sz- According to [23] 
we use Sz = 4% which leads to 2% vertical/horizontal 
flux uncertainty. We take for the overall flux normal- 
ization uncertainty = 10% and for the neutrino 
cross-section uncertainty: S^. = 10%. 

In our analysis the numbers of events have 
been computed for the theoretical (fit) values and ex- 
perimental (true) values of parameters in the same 
way by migrating the number of events from the neu- 
trino to muon energy and zenith angle bins. The res- 
olution functions have been taken from the previous 
work [24]. 

In studies of sensitivity to the 2-3 mixing we 
marginalize over Am|2, ^13, Sep for v's and u's 
separately. Then we find the total as = xt+xl- 
size in the (logj^g E - i" "') plane, where L = 2Rcosdz We have chosen the following benchmark values of 



III. THE ANALYSIS FOR ICAL 

To evaluate physics potential of the atmospheric 
neutrino studies with a magnetized ICAL detector we 
generated the atmospheric neutrino events and con- 
sidered the muon energy and direction (directly mea- 
surable quantities) using event generator NUANCE- 
v3 [20]. The GEANT [21] simulation of ICAL detec- 
tor shows that the energy and angular resolutions of 
muons are very high and the corresponding uncertain- 
ties are negligible compared to differences between the 
angles as well as energies of the neutrino and muon 
in the scattering (production) process. 

X^ is calculated according to the Poisson distribu- 
tion. The term due to contribution of prior informa- 
tion on the oscillation parameters measured by other 
experiments is not added to x^ here for conservative 
estimation; the effect of priors will be considered in 

sec. V. The data have been binned in cells of equal 

-0.4 
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FIG. 1: The oscillograms for the octant asymmetry: The contours of equal asymmetry A°'^'F^/F,° for neutrino (left) and 
antineutrino (right) with ~ 5° at 613 — 0. The other parameters are set at their best-fit values. 



the neutrino parameters: Ar 



'32 



2.5 X 10^3 gv2, 



Sc 



0, Ar 



'■21 



7.9 X 10" 



5 eV^ and 6*12 = 34.24°. 
In marginalization we use, first, flat distributions 
of values of the parameters in the following ranges: 
Amj^ = (2.3 - 2.7) x IQ-^eV^, 623 = 36° - 54° and 
0i3 = 0° — 10.5°. The range of 613 is changed for 
some particular analyses. (The non-flat distributions 
of parameters will be considered in sec. V.) 

The parameters Am^i and 612 produce sublead- 
ing effects on the atmospheric neutrino fluxes for 
E > 1 GeV. Moreover, effect of these parameters in 
marginalization is very small due to their narrow al- 
lowed regions. Therefore we have taken fixed values 
of Am|]^ and 9i2 in our analysis. 



IV. SENSITIVITIES OF ICAL 



In our computations we explored the neutrino en- 
ergy range (0.141 -15) GeV, we used different energy 
thresholds and different exposures, £, of 0.25, 1, 2, 
and 4 Mton-yr. 



A. Determination of 2-3 mixing for 613 = 

The sensitivity of ICAL experiment to 623 is 
shown in fig. 2. We plot 



Ax'^x'{023)~x\0lT) 



(21) 



as function of the fit value for fixed input values 
6»*™^ = 37°, (left) and 40° (right) with £ = 1,2, and 
4 Mton-yr. We have marginalized with respect to 
all the oscillation parameters except 623. The figure 
shows high sensitivity to the deviation 623' it would 



be possible to discriminate between a given 623 and 
maximal mixing at 99% C.L., if \523\ > 5°. For in- 
stance, after 1 Mton-yr the angle 6*23 = 37° can be 
distinguished from 45° at 8a level. 

The figure shows also low sensitivity of the ex- 
periment to the octant. Indeed, Ax^ is higher in the 
right minima which correspond to the wrong octant. 
After 1 Mton-yr exposure the difference of Ax^ in 
the true and wrong octants is smaller than 1. The 
difference becomes more than 2 (90% CL) only af- 
ter 4 Mton-yrs. Identification of the octant becomes 
even more difficult for smaller ^23. If <^23 = 5°, we 
find Ax^ = 1.2 for £■ = 4 Mton-yr. This result 
can be readily seen from our analytical consideration 
in sec. II. The probability Pg averaged over the en- 
ergy interval (0.14 - 15) GeV equals (Ps) ~ 0.02, 
so that for $23 = 8°: A°'=*F^/F/? - 4 - 10"^ whereas 
/\^d.evp^^pO ^ Q _ an order of magnitude larger. As 
we mentioned before, this big difference of sensitivi- 
ties to the deviation and octant (degeneracy) is be- 
cause the octant asymmetry is collected only at very 
low energies where Ps is unsuppressed, whereas whole 
energy range contributes to the sensitivity to the de- 
viation 623. 

The sensitivity to S23 drops down substantially 
with decrease of 623- Reducing ^23 from 8° to 5° 
(compare the left and right panel of fig. 2) leads to 
decrease of the flux difference of eq. (17) by factor 
2.5, and correspondingly, significance of discrimina- 
tion from maximal mixing becomes 2a (for £ = 1 
Mton-yr). Sensitivity to the octant at the la level 
appears only if f > 4 Mton-yr. 

In fig. 3 we show the marginalized Ax^, calcu- 
lated at the maximal mixing (fit value) for different 
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FIG. 2: Dependence of Ax^ on fit value of 623 for fixed input (true) values 6*23 ~ 37° (left) and 40° (right). We used 
^13 — 0, £ = \, 2, and 4 Mton-yr, and the energy threshold 0.141 GeV. The is marginalized with respect to all the 
oscillation parameters except S23. The range of marginalization for On is — 10.5°. 
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FIG. 3: Dependence of the ICAL sensitivity to the deviation from maximal mixing on the input value of ^23 for different 
exposure times: f = 1, 2, and 4 Mton yr. We use the threshold 0.141 GeV. Here h.^^"^ = X^(45°) 
marginalized with respect to all the oscillation parameters except ^23. The range of marginalization for Q\z is 
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10.5°. 
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(22) 



The picture is complementary to that in fig. 2, and 
there is an approximate symmetry with respect to 
^23 = 45°. The reason of sharp increase of Ax^ at 
42 and 48° is related to weak dependence of the oscil- 
lation probability on ^23 = around S23 = and to 
overall flux uncertainty. 

In fig. 4 we illustrate dependence of the sensitiv- 
ity to the octant on 023- For different input (true) 
values of ^23 we plotted 



According to fig. 4, it will be possible to discriminate 
the octant at 90% CL if 6*23 ^ 38° or > 52° after 
£ = 4 Mton-yr. Notice that the curves are nearly 
symmetric with respect to ^23 = 45°. 

Due to fast decrease of P5 with increase of energy 
(see fig. 1) the sensitivity to the octant disappears for 
high values of the threshold. 



x'(9O°-023)-x'(^?23). 



(23) 
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FIG. 4: Dependence of the ICAL sensitivity to the 623-octant on the input (true) value of 623 for different values of £, and 
threshold 0.141 GeV. Here A°'^'x^ = x^(90° ^ ^23) — X'^(^23)- is marginalized with respect to all the oscillation parameters 
except 6*23. The range of marginalization for On is — 10.5°. 




FIG. 5: Dependence of the ICAL sensitivity to the deviation from maximal 2-3 mixing on the input value of 6^23 for different 
marginalization ranges of Ois. We use £" = 1 Mton-yr and threshold 0.806 GeV. Here A'^'^^x^ = X^(45°) - x^(6'23"'')- is 
marginalized with respect to all oscillation parameters except 623.- 



B. Determination of ^23 in the presence of 
non-zero 1-3 mixing. 

Analysis of the oscillation data testifies for the 
non-zero 1-3 mixing, although significance of this re- 
sult is not high and zero value of Ois is not yet 
excluded. The global fit at Icr C.L. gives ^13 = 
7.3° 112°. with 3tT upper bound of ^13 < 13°, and 
(5cp e [0, 360] [1]. Analysis of the solar and KAM- 
LAND data by SNO collaboration leads to 6*13 = 



8-13°l?:o3° at 95% CL [25]. New and forthcoming 
experiments Double Chooz, Daya Bay, RENO, T2K, 
NOi^A can confirm this result with higher confidence 
level or put new stringent upper bound [26] which 
would correspond approximately to a situation with 
zero 1-3 mixing considered in the previous section. 

By the time when ICAL will collect significant 
statistics the angle ^13 will be known with relatively 
good accuracy. To clarify an impact of this informa- 
tion on the determination of parameters of the 2-3 
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FIG. 6: Dependence of the ICAL sensitivity to the &23-octant on the input value of 623 with £ — 1 Mton yr and threshold of 



0.806 GeV. Here A°'='x = X (90° 



X 



3). X is marginalized with respect to all oscillation parameters except 



sector we have performed analysis for non-zero 613. 
For illustration purpose we use 6^13 = 5° as the true 
value and different fit intervals with flat distribution 
(which could reflect errors in measurements of ^13). 

In fig. 5 we show dependence of A'^^'"x^ defined 
in eq. (22) on the true (input) value of 023 for the 
fit value 623 ~ 45° and £ ~ 1 Mton-yr. Different 
curves correspond to different marginalization inter- 
vals of 6*13. Comparing these results with the results of 
fig. 3 we find that inclusion of the 1-3 mixing does not 
change significantly the sensitivity to ^23- The reason 
is that this sensitivity follows from the main mode of 
the z^^— oscillations; large probability for this mode 
extends to higher energies and 1-3 mixing produces 
just additional distortion of the oscillatory pattern. 
However, inclusion of the 1-3 mixing makes the curve 
less symmetric with respect to 45° which reflects an 
increase of sensitivity to the octant. Also sensitivity 
to the deviation weakly depends on the marginaliza- 
tion interval for 613. 

Fig. 6 illustrates the sensitivity of ICAL to the 
octant in the presence of non-zero 1-3 mixing. We 
show dependence of A°^*x^ defined in eq. (23) on the 
true value of e^'^'' for the fit value 61^3* = 90° - 623. 
Different curves correspond to different marginaliza- 
tion intervals for ^13. There are two important fea- 
tures of the fig. 6. First, the sensitivity to the octant 
is substantially better for non-zero value of ^13 than 
for vanishing 1-3 mixing (fig. 6) as was also shown 
in previous publications [13, 27-29]. This is related 
to the fact that the octant asymmetry of the flux is 



determined now by 



/S^octp 



sin 26' 



23 



(24) 



723 ~ 

(A°=*X^ = 4) with £ 



and (Pa) ~ 0.1 in the interval E = (0.14-15) GeV; it 
is much larger than (P5) being enhanced in the energy 
range E = (3 - 10) GeV (in the resonance channel). 
Furthermore, at high energies r ~ (3 — 4) and value of 
the coefficient in eq. (24) becomes larger. As a result, 
for 6*53 = 51° the octant can be identified at 2(7 level 
= 1 Mton-yr, as compared to 
3-0. 

The second feature is significant asymmetry of 
the curves with respect to 623 = 45°. The asymme- 
try is practically absent for fixed input value of ^13 
but it increases with broadening of the marginaliza- 
tion interval, and more importantly, with increase of 
the lower border of this interval. For 623 > 45° the 
curves are practically not changed with change of the 
interval, whereas for 623 < 45° the sensitivity sub- 
stantially decreases. For instance, taking 623 = 40° 
we obtain Ax^ = 1 for the interval 6*13 = (3° - 12.5°) 
instead of A°''^x^ = 3 for fixed value 613 = 5°. 

This asymmetry can be readily understood from 
the analytic consideration of sec. II. Neglecting the 
effect of 1-2 mixing the i'^— flux can be presented as 



if (sin 2^23) 



f{023) ( 1 - J ) Pa{013), (25) 



where ^(sin 2623) is an even function of the deviation 
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(symmetric with respect to change of the octant), and 



/(^23) ^ S 



,4 ■'23 
'23 



(26) 



quickly increases with 623, so that for r = 3 — 4 one 
has f{e23 = 40°) < /(6'23 > 50°). Therefore for 6*23 < 
45° the flux has much weaker dependence on ^13 
than for 6*23 > 45°. In the process of marginahzation 
over 6*13 we compare the true value of the flux, Fj^™'^, 
with the fit value, F^'*, and A°'^*x^ is proportional to 
their difference: 



1 



fro r tJ. 









(-;) 







\fiO23){PAi0T3n) - /(90° - e23){PAiei3))\i27) 



If the fit value of 1-3 mixing is fixed: '^■^''^ 



13 



Qtrue 
^13 ; 



the curve is approximately symmetric with respect to 
change 6*23 <-> (90° — 6*23). Indeed, in this case we have 
from cq. (27) 

I Tptrue Tpfii 

x{PA{em) If (023) {90°- 923)\. (28) 

The situation is different if ^13 varies in certain inter- 
val 013 = [^"3*" ~ ^13°^]' ^^'i perform marginal- 
ization over ^13 in this interval. Marginahzation 
minimizes the difference of fluxes (eq. (27)) over 
9i3 for a given value of ^23- If ^23 < 45°, then 
7(^*23) < /(90° - 6*23). In this case the difference 
of fluxes is minimal if 6*13 ~ 6*™". Indeed, since 
(Pa) decreases with ^13, a smaU value of (Pa) par- 
tially compensates large value of /(90° — 623) in the 
second term on the right hand side of eq. (27). Fur- 
thermore, the smaller 6*™" the stronger compensa- 
tion, and therefore the smaller Ax^ can be obtained. 
If 6I23 > 45°, then /(6'23) > /(90° - 6I23). Now to 
compensate the first term in eq. (27) one should take 



(Pa (6*13 )) > (Pa(6'i3))- This is, however, not pos- 
sible for the considered values of 6*13. Thus, in the 
case of unprecise determination of ^13 sensitivity to 
the octant is higher for ^23 > 45°. 



Determination of the 2-3 mass split. CPT 
test 



Important advantage of a magnetized calorime- 
ter is that it allows one to measure the neutrino mass 
differences and mixing angles in the neutrino and an- 
tincutrino channel separately. A difference of results 
can be related to some effective or fundamental vio- 
lation of the CPT symmetry. 



In fig. 7 we show dependence of Ax^ on the fit 

I2 = 2.35-10-3 



value of Arrion for the true value Am 



'32 

eV^ in the neutrino and antineutrino channels. We 
take 9 13 = 5° and 6*23 = 45°. According to this figure 
with £ = 0.25 Mton-yr the value Ato§2 = 3.3 • 10"^ 
eV^ can be discriminated from the true value at about 
2a level. 

The accuracy of measurement of ^171^2 is better 
in the channel. For £ = 0.25 Mton-yr the error in 
:^-channel is about two times smaller than that in 9 
channel. The difference of accuracies decreases with 
increase of exposure and e.g. for 1 Mton-yr it becomes 
about 25%. The curves Ax^ are asymmetric with re- 
spect to Amlj*"^"*^, which is related to the dependence 
of oscillation probability on Am|2. 

The la error for Aml^ could be 0.15 - lO'^ eV^ 
and 0.04-10-3 eV^ after 0.25 Mton-yr and 1 Mton-yr 
exposures correspondingly. With £ = I Mton-yr the 
error 0.15- 10^^ eV^ can be achieved at 3a level. With 
£ = 1 Mton-yr one can obtain an accuracy 0.08 - 10-^ 
cV^ (90% C.L.) which is better than the present MI- 
NOS accuracy. 

In figs. 8 and 9 we show Ax^ as function of ATO32 
and 023 in the neutrino and antineutrino channels for 
£ = 0.25 and 1 Mton-yr. As true values we take 
6*23 = 45° and Am§2 = 2.35 - lO^^ eV^. According 
to fig. 9 the present MINOS resuh for v (|Am§i| = 
3.36 - 10-3 eV^ 6*23 = 34°) can be excluded by ICAL 
at about 6a level with £ ~ 1 Mton-yr. 



FURTHER IMPROVEMENTS OF 
SENSITIVITIES 



There are several directions in which sensitivity 
of ICAL can be further improved. 



A. Adding information about hadrons 

Measurements of the hadron energy in ICAL in 
addition to the muon energy is expected to improve 
reconstruction of the neutrino energy for £^ ^ 2 GeV. 
However, the total hadron energy in an event is car- 
ried out by multiple low energy hadrons. The average 
energy per hadron per event is ^ IGeV and the aver- 
age number of hadrons per event is ^ 2 At £^ ^ IGeV 
the energy resolution is very poor, roughly 80%, and 
the number of hits (number of active detector layers 
in which signal is detected) increases only logarithmi- 
cally with E. 

The resolution of hadron energy (for all pions 
and kaons) at ICAL has been obtained from GEANT4 
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FIG. 7: Dependence of on the fit value of Am32 for the true value Am32 = 2.35 x 10"'^ eV^ in the neutrino and 
antineutrino channels. We use E = 0.25 and 1 Mton-yr and the threshold 0.8 GeV. The marginalization is done over all 
the oscillation parameters except A7TI32. The x values 1, 4, 9 correspond to Icr (68.3%), la (95.4%), and 3(7 (99.73%), 
respectively. 



neutrino, 0.25 Mton.year, contour x = 1 , 2, 3, . 




antineutrino, 0.25 IVIton.year, contour x =1,2,3,... 




FIG. 8: The iso-^'^ contours in the Am32 



plane for neutrinos (left) and antineutrinos (right) obtained with £ — 



0.25 Mton yr. The inner contour corresponds to x =1 and others with increment 1. We use the input value Am32 — 
-2.35 X 10-^eV^ 6*23 = 45°, dn = 5° and the threshold 0.8 GeV. Here Ax^ values 2.3, 4.6, 9.2 correspond to la (68.3%), 
2a (90%), and 3a (99%), respectively. Intensity of color reflects value of Ax^ (see column on the right hand sides of the 
panels for identification). 



simulation and parametrized as 

/Ehad = a/^K7d + b, (29) 

where, a « 0.60 and b « 0.1 for the thickness of iron 
layer 5.6 cm and after averaging over all directions. 

For each hadron in an event we find the recon- 
structed hadron energy (i?^^^) by a random num- 
ber method using the value of ahad from eq. 29. 
Then we find the final resolution as a function of 
[E,-{E^+EZf)]/E,; where, E^f is the sum of the 
energies of all reconstructed hadrons in an event. We 
use the atmospheric neutrino events without oscilla- 
tions for an exposure of 50 x 1000 kTon-yr generated 
by Nuance to reconstruct the resolution functions for 



each energy and zenith angle bins. 

In fig. 10 we show the iso-x^ contours with and 
without inclusion of information about hadrons. We 
find that improvement of the sensitivity to 623, and 
therefore 523, is marginal. Also there is a very small 
change in the sensitivity to Am§2: ^(^™32) = 0-02 • 
10-3 cV2. 



B. Cross-sections and fluxes 

Figs. 11 and 12 illustrate improvements of the 
sensitivities with reduction of different systematic un- 
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neutrino, 1 Mton.year, contour x = 2, 4, 6, ... 




antineutrino, 1 Mton.year, contour X 




A m^2 (eV ) 



A m^/ (eV^) 



FIG. 9: The same as in fig. 8 but for £: = 1 Mton yr. 
increment Ax^ = 2. 



The inner contour corresponds to x =2 and for other contours the 



only muons, 1 Mton.year, contour = 2, 4, 6 




muon + hiadrons, 1 Mton.year, contour % =2,4, 6, 




FIG. 



The iso-x^ contours (from inner side x^ = 2 with 
IVIton yr, the threshold 0.8 
GeV for both muons and hadrons. and sum up the signals from neutrinos and antineutrinos. 



10: Effect of inclusion in the analysis the information on hadrons. 

2 



increment 2) in the /S.mi,2 — plane without hadrons (left) and with hadrons (right). We take 1 



certainties. Decrease of uncertainties of the over- 
all flux normalization, the ratio of horizontal/ vertical 
flux, the neutrino cross-section, and the tilt (below 
1 GeV) from 10%, 10%, 2%, and 15% to 2%, 2%, 
2%, and 3%, respectively, do not lead to significant 
improvement of the sensitivities. The reason is that 
the up-going neutrinos oscillate and down-going neu- 
trinos remain practically unchanged. In analysis 
these down-going neutrinos allow to reduce the ef- 
fect of systematic uncertainties in fluxes. Significant 
improvement occurs only when all systematic uncer- 
tainties are zero. 



C. Adding priors to 

In x^ analysis in sec. 4 for simplicity we used flat 
distributions of uncertainties of the oscillation param- 



eters in marginalization. The prior contribution of 
the parameters to . should improve the sensitivity. 
Proper procedure would require the use of the best- 
fit values and variations of parameters (especially ^13) 
which will be possible after results of forthcoming ex- 
periments will be known. 

In figs. 13 and 14 we show improvements of the 
sensitivities to the ^23 deviation and the octant due 
to inclusion of the prior contribution. We have as- 
sumed the Gaussian distribution of the uncertainties 
around the best fit with width a{siT? 29iz) = 0.01, 
cr(sin^ 26*23) = 0.0 1 5 and cr(Am|2)/Ami2 = 0.015 
following [30, 31]. The 2a errors in measurements 
of Am32 are ±0.09 with flat uncertainties of oscilla- 
tion parameters, ±0.07 with prior information from 
present global-fit, and ±0.018 with prior information 
from possible T2K result. 

The asymmetry in the sensitivity to the octant 
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true 613=5° 
Marginalization range of 613: 4.5° - 12.5 ° 
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FIG. 11: The same as in fig. 5, but with reduced systematic uncertainties. 




FIG. 12: The same as in fig. 6, but with reduced systematic uncertainties. 



(which was due to the uncertainty of ^13 in absence 
of prior contribution) now disappears, and the result 
does not depend on marginahzation range. 

Of course, larger values of ^13 can substantially 
enhance the sensitivity to the octant since Pa ^ 
sin^ 013 at low energies. 



VI. CONCLUSION 

We have studied analytically the dependence of 
the ^23— deviation effect and octant asymmetry of v^J^ 
and fluxes on the neutrino parameters ^23 and ^^13. 



We explored numerically a sensitivities of a magne- 
tized calorimeter to the 023-deviation, to the octant 
and to Am32. 

We show that for 6*13 = the sensitivity of ICAL 
to the octant is low even for maximally allowed val- 
ues of the deviation of the 2-3 mixing from maximal. 
This is related to the fact that the octant asymmetry 
is proportional to the "solar" probability Pg which is 
large: 0(1) sX E 0.1 GeV but quickly, as oc E'"^, 
decreases with energy. The situation can be improved 
by lowering the threshold, increasing exposure and 
reducing systematic errors (especially in spectral in- 
dex). We find that sign{8i-i) (octant) can be estab- 
lished at 90% C.L. if 7°, f = 4 Mton-yr and 
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FIG. 13: The same as in fig. 5, but with the contributions from priors for the oscillation parameters added to x" (see text) 
The marginalization range for On is 3° — 12.5°(0° — 12.5°) in absence (presence) of prior contribution. 
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FIG. 14: The same as in fig. 6, but with the contribution from priors for the oscillation parameters added to the ■ 
marginalization range for ^13 is 3° — 12.5° (0° — 12.5°) in absence (presence) of prior contribution. 



The 



Eth = 0.141 GeV. 

ICAL has good sensitivity to the 023-deviation 
from maximal 2-3 mixing: the effect is proportional 
to the probability of the main channel of oscillations, 
— Vt, which is unsupprcsscd in whole considered 
neutrino energy range. As a result, dependence of the 
sensitivity on the energy threshold is weak and it does 
not change substantially when the effect of 1-3 mixing 
is included. We find that with the 1 Mton-yr exposure 
the 3(7 accuracy of determination of the deviation will 
be I (523 1 ~ 6°, which is better than the present global 
fit result and slightly better than expected sensitivity 



of T2K («9°). 

The oscillations driven by non-zero 1-3 mixing 
substantially improve the sensitivity to the octant. 
One can determine the octant for = 5° and 
6*13 = 5° at 90% C.L. with 1 Mton-yr exposure. We 
find that this sensitivity depends crucially on the un- 
certainty range of ^13. For a given nonzero ^13, the 
sensitivity to octant discrimination is symmetric in 
^23 with respect to ^23 = 45°. However, the asymme- 
try arises (smaller sensitivity for ^23 < 45°) if value of 
Oi3 can vary in large range. The symmetry is restored 
if prior for the 1-3 mixing is added. 
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TABLE I: Results of determination of 623 



023 


CL 


Source 


42.9°lt.8o 


1(7 


global-fit [2] 


35.7° - 54° 


3cr 


global-fit [2] 


-7.8° 


99% 


SK [4] 


45° ± 9° 


90% 


MINOS {v) [4] 


34°^^: or 56°!^: 


90% 


MINOS {v) [.5] 


39° - 51° 


2(T 


T2K [32] 


36° - 54° 


2(T 


NOr^A [32] 


40° - 50° 


2(7 INO (1 Mton-yr) 



TABLE II: Results of determination of Amli 





CL 


Source 


-2.36±0.07(±0.36) 1 (3)(t 


global-fit [2] 


+2.47±0.12(±0.37) 1 (3)cr 


global-fit [2] 


n r-FO.52 
^•>^-0.60 


99% 


SK Zv [4] 


9 qc+O.ll 


90% 


MINOS V [5] 


oc+0.45 


90% 


MINOS u [.5] 


2.5 ±0.04 


20- 


T2K [32] 


9 r-l-0.07 


2cr 


NOi/A [32] 


2.5 ±0.07 


2(7 INO (1 Mton-yr) 



The accuracy of measurements of ATO23 by 
ICAL, A(Am|3) = 0.15 • IQ-^ eV^ (3cr, 1 Mton-yr 
exposure), is two times better than the accuracy of 
the present global fit and it is worthier than the ex- 
pected sensitivity of T2K. 

ICAL can measure the difference of Amgj in 
v and V channels (the CPT test) with accuracy 
0.8 X 10~^ eV^ at Str confidence level with 1 Mton-yr 
exposure and the present MINOS result can be ex- 
cluded at > 5(T confidence level. 

We find that inclusion of information about 
hadrons from neutrino interactions does not change 
the sensitivity to the oscillation parameters sub- 
stantially. Also improvements of the sensitivity 
due to better determinations of the cross-section 
and neutrino flux are rather modest. However, the 
sensitivity improves substantially with adding priors, 
especially for the 1-3 mixing, and of course, with 
increase of the absolute value of 1-3 mixing. 
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